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SIGNIFICANCE  AND  EXPLANATION 


In  the  solution  of  very  large  systems  of  linear  algebraic  equations  one  is 
frequently  led  to  consider  "iterative  methods".  In  these  methods  one  chooses  a 
first  guess,  say  iP , and  then  successively  computes  other  guesses  . 

The  basic  questions  about  such  a method  are  (i)  Does  the  metl^od  work?  That  is, 
assuming  I c2m  keep  up  the  procedure,  does  U get  near  to  the  true  answer  U? 
(ii)  How  expensive  is  the  method?  That  is,  assuming  I can  estimate  the  cost  per 
Iteration,  how  many  iterations  are  required  to  decrease  the  initial  error 

I 0 1 

|U  - U I by  some  fixed  "small"  factor,  say  fi.  Both  of  these  questions  are 
answered  by  obtaining  information  on  a quantity  p which  is  associated  with  the 
iterative  method.  This  report  discusses  some  wavs  of  obtaining  good  asymptotic 
estimates  for  p iji  an^  important  class  of  problems  associated  with  second  order 
elliptic  partial  differencial  equations. 
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The  responsibility  for  the  wording  and  views  expressed  in  this  descriptive  summary 
lies  with  KRC,  and  not  with  the  authors  of  this  report. 


ON  BLOCK  RELAXATION  TECHNIOUES* 


D.  B.  L.  Buzbee^^^ 

and  S.  V.  Parter^^^ 

1.  Introduction 

Some  15-20  years  ago  there  was  a great  interest  in  iterative  methods  for  elliptic 
difference  equations  - see  (131,  (14],  (151,  (7],  (9],  (101.  More  recently 
there  has  been  a greater  emphasis  on  direct  methods  for  these  sparse  matrices  - see  (51 , 

[6],  (111,  (121. 

However,  with  the  advent  of  "vector  machines"  and  "parallel  processors"  we  have  found 
it  necessary  to  return  to  a consideration  of  certain  iterative  methods. 

The  CRAY-1  computer  ceui  perform  up  to  250  million  floating  point  operations  per  second 
[2].  Algorithms  that  execute  with  high  arithmetic  efficiency  on  this  computer  must  "fit  the 
architecture"  of  it  and  be  carefully  programmed  in  assembly  language.  Thus  in  using  this 
computer,  we  seek  computational  modules  that  can  be  implemented  efficiently  and  that  can  be 
used  in  solving  diverse  problems.  The  solution  of  banded  positive  definite  linear  systems 
Is  such  a module,  and  the  Cholesky  decomposition  algorithm  for  it  can  be  implemented  on  the 
CRAY-1  such  that  its  execution  proceeds  at  the  rate  of  about  100  million  floating  point  opera- 
tions per  second.  Since  the  vector  registers  of  the  CRAY-1  can  hold  at  most  64  numbers,  im- 
plementation of  banded  Cholesky  is  simplified  if  vector  lengths  do  not  exceed  64.  Block 
Relaxation  techniques  for  solving  elliptic  difference  approximations  require  the  solution  of 
banded  positive  definite  linear  systems.  These  facts  led  us  to  investigate  the  convergence 
rate  of  block  successive  over-relaxation  for  the  model  problem  using  p * p blocks  (prefera- 
bly p ^ 64) . 
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In  ( 9l  one  of  us  developed  a fairly  general  theory  for  obtaining  such  estimates 
on  the  rates  of  convergence  of  iterative  methods  for  elliptic  difference  equations. 
However,  partly  because  of  the  generality  of  that  work  (variable  coefficients,  general 
domains,  etc.)  it  is  by  no  means  a transparent  discussion.  On  the  other  hand,  in  the 
case  of  the  model  problem  it  is  relatively  easy  to  develop  this  general  approach.  This 
Is  partly  due  to  the  strong  estimates  of  ( 1 1 and  I 8 ] . 

In  section  2 we  describe  the  model  problem  and  iterative  methods  for  its  solution. 

In  section  3 we  develop  the  general  theory  (for  this  special  case).  In  section  4 we 
obtain  the  rates  of  convergence  estimates  for  the  p * p block  method  mentioned  earlier. 
In  section  5 we  apply  the  theory  to  the  multi-line  methods  (these  methods  have  been 
studied  earlier  (9],  (lOl). 

Finally,  because  it  is  worthwhile  for  the  practical  worker  to  have  available  many 
methods  for  getting  Information  on  rates  of  convergence  (some  work  here  - others  there) , 
in  section  6 we  return  to  multi-line  methods.  Using  a completely  different  technique 
we  obtain  upper  bounds  (unfortunately:  not  sharp  bounds)  on  the  rates  of  convergence. 
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3.  Ttir  Mtxlcl  rtolili  m 


Let 


3.1) 


n i { (x.y) ; 0 < x.y  < 1 ) . 


L»t  r be  A fixpii  integer  xml  set 


P ♦ 1 


Consivlct  tlu'  set  of  interior  mesh  points 
2.3) 


Q(h)  - * (k.h,jh)), 


1 < )i,J  s P 


•s  well  as  the  boundary  mesh  points 

з. 3)  3n(h)  f ((X  ,y  )i  (li  - 0 or  P ♦ 1)  or  (j  - 0 or  P ♦ 1))  . 

^ J 

Let  U • (u  ) be  a vector  defined  on  the  set  of  all  grid  points!  n(h)  U 311(h)  that  is, 
^ J 

и.  . is  the  value  of  U at  (x.  ,y.).  Me  call  0 a "grid  vector".  In  differing 

xj  k j - 

circumstances  we  will  choose  different  order ings  of  the  components  of  0. 

As  usu.ll,  we  define  the  discrete  Laplace  operator  by 


3.4.S) 


,AU)  - . 1 < k,j  s p 

h )tj  .3  3 - - 


Motet  Willie  0 is  defined  on  the  entire  mesh  region,  A.U  is  defined  only  on  il(h) 

h 


the  interior.  Also,  we  define  the  difference  operators 

lij<P,  l<k<P+l, 


3.4b) 


■VU  i ■ 

31  X f J n 


|v  u)  • -KiJ XiJjiV 

‘ y ')i.j  h 


3.4c)  IV.U1,.  ^ J-  - , IsJ^Prl,  litilP- 

The  basic  problem  is;  Given  grid  vectors  F and  C,  find  a grid  vector  U such 


that 

3.!>a)  • r,  in  n(h)  , 

3. MO  O » C,  on  3il(h)  . 

After  an  ordering  of  the  (Mints  ‘^•f'tminevi  we  let  A be  the  matrix 

rept erentat ion  of  -h  A ; symbol ically,  wo  write 

n 

3.6) 


~ -h’ 


h 


3 


2 

Aa  we  have  already  remarked  A.  maps  vectors  with  P ♦ 4P  components  into 

h 

2 2 2 
vectors  with  P components.  The  matrix  A actually  is  a square  P by  P matrix. 

The  known  boundary  values,  C,  are  put  on  the  riqht-hand-side . In  this  way  the 

difference  equations  (2.Sa),  (2.5b)  take  the  form 

2.7)  AV  - r 

*rtiere  the  ' over  F Is  meant  to  Indicate  both  the  result  of  ordering  the  comi>onents 
of  -h^F  and  the  necessary  modifications  of  F required  by  the  G terms.  In  any  case, 
evejut  vector  V with  P^  components  may  be  thought  o£  « a grid  vector  which  also 


satisf ies 


V - 0 on  3!)(h) 


An  Iterative  method  for  the  solution  of  (2.7)  is  determined  by  a "splitting* 


Equation  (2.7)  is  then 


A • N • N . 


MV  - MV  ♦ F . 


After  choosing  a first  guess  V*^,  one  obtains  V^  ,V^, . . . .V*^, . . . from 


NV  ♦ F . 


2*11)  P ■ »sx(|X|i  dat(XM  - N)  » O)  . 

It  Is  »#ell  known  that  the  iterates  V**  converge  to  the  unique  solution  V of  (2.7) 
If  and  only  if  (independently  of  V*^) 


The  problsD  studied  in  this  report  Isi  find  the  asymptotic  behaviour  of  0 as  h 0. 
Remarkt  Of  course,  for  every  1 which  is  a generalized  eigenvalue,  (i.e.  dct(lM  - N)  *0) 
there  la  a vector  U ^ 0 such  that 


2.11) 


XHU  • NU  . 
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3.  A Conrral  Approach 

W«  Mk«  some  assumptions  about  the  splitting  (3.9a)  . 

* 

A.l)  N - M and  is  positive  definite 

< Nx,x  > 


A. 2) 

where 


p • max 


< MX , X > 


(x,y>  - x-^y  - r x^.y^,  . 

* • * 

Note:  Since  A - A , M - M then  N “ N ; and,  as  is  well-ltnown  ( 4 1 the  generalized 

eigenvalues  are  all  real  and 


p • max 
X*0 


|<  Nx,x>| 


( Mx,x  > 

Thus,  the  force  of  the  assumption  (A. 2)  is  that  max | \ | occurs  for  a positive  eigen- 
value A - p . 

A. 3)  There  is  a positive  constant  Nq,  independent  of  h,  such  that 


Here 


I|n||.  • Sup{  1 (NU)j^^  I ; <1}  . 

Finally  we  come  to  the  main  new  concept. 

A. 4)  There  are  positive  constants  q,  K,  independent  of  h,  such  that:  if  U is 
a grid  vector  satisfying 

(1)  0-0  on  3n(h) 

and 

<ii)  |V^0|  ♦ |v^ul 

for  some  constant  B,  then 
3.1) 
where 

3.1a)  |e|  < KB/h  . _ 

Aemarki  As  one  might  imagine,  the  determination  of  q and  the  verification  of  (A. 4) 
la  the  important  technical  aspect  of  this  analysis  when  applied  to  any  particular  case. 
However,  as  we  shall  sec  in  sections  4 and  S,  it  is  not  too  difficult. 


< NU,U>  - q<U,U>  + E 


-5- 
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3.1;  Suppose  the  splitting  (2.9a)  satisfies  (A.l)  and  (A. 2).  Then  the  method 


Is  convergent.  That  is; 

3.2)  P < 1 . 

Proof ! Let  V be  the  eigenvector  associated  with  p.  Then  <NU,0>  ^ 0.  Since 

M • A ♦ N and  A is  positive  definite,  we  have 

< NU,U>  _ < NU,U) 

— “ <MU,U)  ” fAU,U>  + <NU,U>  * 

The  basic  result  of  this  section  is 

Theorem  3 . 1 Suppose  the  splitting  (2.9a)  satisfies  the  conditions  (A.l),  (A. 2),  (A. 3) 
and  (A. 4) . Then 


3.3) 


2 

p ■ 1 - h ♦0(h) 


Proof;  Let  U be  the  grid  vector 

3.4)  “ (sin  )cith)  (sin  jsh)  . 

Then  O satisfies  conditions  (i) , (ii)  of  (A. 4).  In  particular,  because  of  (i)  we 
say  spea)c  of  <NU,U)  and  (U,U>.  The  constant  B of  (ii)  is  2ii.  The  following 
facts  are  well  )cnown  (see  [13]  particularly  page  202)  . 


3.5) 

h^<u,oJ  - 

- f- 

4 (P  ■ 

3.6) 

h^<A0,D>  . ... 

. - 4(1  - 

h*<U.U> 

cossh)  • 

, 2.  2 
2s  h 

For  all 

V which  are  zero  on  90  (h)  and 

V ^ 0 

3.7) 

-h^V.v)  1 

h^(AV,V> 

t. 

h^<V,V>  h^ 

_h^(V,V>  _ 

_1_ 

12 


JL_ 

12 


Since  M - A ♦ N 


Applying  (A. 4)  vt  have 


( W0,U>  )i^(NU,U> 


h^<MU,U>  - qlh*<U,0)l  ♦ h^E  . 


-6- 


And,  using  (3.5)  w«  have 


r 


h*<NU,U>  - Iq  ♦ 0(h)  1 th^<u,u>l 


Tttus 


0 > 


1 + 


h <AU,U> 


Using  (3.6)  we  obtain 
3.0) 


(q  ♦ o(h) ) (h  <u,u>) 


p > 1 - ^ ♦ o(h^)  . 


In  order  to  obtain  the  reverse  inequality  we  require  some  basic  estimates  of  I 1 ) 
and  ( 8 1 . These  are 

3 .2:  Let  V be  a grid  vector  which  is  zero  on  30 (h) . Then 


3.9) 


Proof:  See  lemma  8,  page  304  of  [8  I. 

3.3:  Let  V be  a grid  vector  which  is  zero  on  30(h).  Then 


3.10a) 

3.10b) 


I’yVl  < maxlAj^v]  . 


Proof : This  result  is  contained  in  Theorem  5,  page  408  of  II). 

For  convenience  of  notation,  for  every  grid  vector  V,  restricted  to  the  interior 
Q(h) , we  write 


3.11) 


lIvlL  - {h^v,v>}^/2  . 


Returning  to  the  proof  of  the  theorem,  let  U be  the  eigenvector  associated 
with  p and  normalized  so  that 


3.12) 

Then 


1 . 


pKU  - NU 

pAU  - p(M  - N)U  - (1  - P)NU  . 


-7- 


r 


-4.  U • UNU 
n 


T1\«t  Is 
1.13s) 
whsrc 

1.13b)  y - (1  - o)/ch^  . 

Froa  lesna  3.1  and  (3.8)  we  see  that 

1.14a)  0 < y 

and 


3.14b) 


lia  sup  y < 


h-^ 


- q 


Moreover,  t)ie  theorem  will  be  proven  if  we  show  that 

2w^ 

y - + 0(h)  . 


Me  write  (3.13a)  as 


where,  if  h is  small  enough 


Applying  lenna  3.2  we  see  that 


Thus 


-V  ■ ♦ 


(♦11  < N ” N . 

' ‘ 9 “ <1  0 1 


l“kjl  IT  • 


l^jl  1 - ^2  . 

Applying  lemma  3.3  we  have  (li)  of  (A. 4)  with  B 2Nj.  Hence,  using  (A. 4)  we  have 


Or,  stalling  use  of  (3.12) 
3. IS) 

(3.13a)  we  have 


h^<NU,u>  - q[h’<u,u>l  h*E  . 


h^<MU.U>  - (q  ♦ 0(h)  1 lh^<u,U>)  . 


-8- 


4.  p P Blocks 

Let  p be  a fixed  integer  and  assume  that 

4.1)  P - PQ  - 

Of  course,  as  P • (i.e.  h -♦  0)  Q * • and  vice-versa. 

2 

The  Interior  grid  vector  is  arranged  into  sub  grid  vectors  P entrees 

as  follows 

4.2)  0 - (o,  ^ ^ ; 1 < o.u  < p),  1 r.s  ^ 0 . 

rs  (r-l)p+o, (s-l)p+u  — — — — 


Within  U,  the  U are  ordered  as  follows 

rs 


4.3) 


0 • (u  .u  . 

' 11  21' 


V'“i2'“22' 


Q2'  “iQ' 

That  is;  we  start  at  the  bottom  row  of  p x p blocks  and  count  off  from  left  to  right; 
then  to  the  next  (second)  row  of  p * p blocks  - again  from  left  to  right,  etc.  Within 
each  block  subgrid  vector  is  ordered  in  the  same  manner.  To  be  specific, 

let  C(r,s,u),  u - 1,2, ,p  be  the  p vector  of  grid  values  associated  with  the 

)»rizontal  line  within  the  (r,s)  block.  That  is 

^(r-l)p+l,  (s-l)p+u 


4.4) 


G(r,s,u) 


then 


4.5) 


(r-l)p+2, (s-l)p+u 


(r-l)p+o, (s-l)p+y 


rp, (s-l)p+u 


G(r,s,l) 


G(r,s,)J) 


rs 


lc(r,s,p)_ 

The  discrete  Poisson  equation  (2.5a),  (2.5b)  takes  the  form 

4.6) 


i 

I 

J 

r 


10- 


ni,itr  levs . 


E^ich  is  block  tridljqonal  of 


wh«r«  T,  * P^ 

‘psaudo  order**  p and  each  block  Is  a p * p matrix.  Specifically 

T " (-1  .R  .-I  I "block  tridiaqonal" 

P P I' 

R • (-1,4, -11  tridiaqonal  . 

P 

If  is  the  P “ P m..irix  with  "I"  in  the  (a,S)  position  and  zero  elsewhere,  then 


4.7a) 

4.7b) 

Notice  that 


R , “ diaqonal(K  ,r,  E,  ) , 

-1  Ip  Ip  Ip 


R,  - diaqonallK  ,,r  ,1 

I pi  pi  pi 


IP 


o 


E , - E, 
pi  Ip 


The  siatrix  B , is  the  "block"  E.  while  B.  Is  the  "block"  E , . That  is 
-1  Ip  1 pi 


4.8) 


B . ■ 

r ■ 

p 

, P • 

O' 

-1 

[0  , 

' 1 

, 

1 

up  J 

We  rewrite  (4.6)  as 


4.9) 


MU  - NU  ♦ r 


where  M • diaqonal(T,T T)  and  N is  mavie  up  of  A i'®i' 

lie  see  at  a qlance  that  M is  positive  definite  and  (A . 1 ) is  satisfied.  Further- 

More,  we  are  dealing  with  a "block"  five  jxjint  star,  that  is,  the  equations  have  the 

sasM  block  structure  as  the  original  problem.  Therefore,  our  splitting  has  "block 

property  A".  Thus,  we  have  the  basic  result,  if  X is  an  eigenvalue  of 

dat(XM  - N)  • 0,  50^  zl.  (14),  115)).  Therefore  (A . ?)  is  satisfied. 

Now,  N only  Includes  the  coefficients  in  A which  relate  points  in  the  (r,s) 

h 

block  with  neighboring  points  in  the  four  blocks  (rtl,s),  (r-l,s),  (r,s<-l),  {r,s-l). 

Me  see  that  each  row  of  N not  coi^espiMul in<j[  to  a corner  jpoiju  of  the  (r.s)  block 

has  at  most  one  "1"  and  all  other  entrees  are  "0".  The  rows  correspt'ndinq  to  corners 

lead  to  exactly  two  "l"'s.  Thus 

4.10)  IInII,  - 2 , 

and  (R. 3)  is  satjsfied  with  • 2. 


11- 


Finally  wc  turn  our  attention  to  the  determination  of  q and  the  verification 
of  (A. 4). 

Lemma  4.1:  Suppose  U is  a grid  vector  which  satisfies  (i) , (ii)  of  (A.4) . Then 


4.11a) 


4.11b) 


< NU,U>  - - < U,U)  + E 
P 


|E|  <if-. 


That  is,  (A.4)  is  satisfied  with 


4.12b) 


Proof : We  have 


Consider  a term 


4 

-p 


K > 16B 


<N0,0>  « T 0^  NU) 

rs  rs 

r,8 


***”’,-»  “ A 0 -f  A,U  + U*’’  B ,U  , ♦ B,u  , . 

rs  rs  rs  -1  r-l,s  rs  1 r+l,s  rs  -1  r,s-l  rs  1 r,s+l 

It  Is  easy  to  see  that 


**rs*-l'^t-l,s  “ “(r-l)p,(s- 


l)p+u  (r-1) p+1, (s-1) p+u 


Fix  o,  1 £ a ^ p.  We  use  (11)  to  write 


" ’*(r-l)p,  (s-Dp-fp  '*(r-l)p+l,  (s-Dp+p 
" ''*(r-l)p.o.(,-l)p.p  " "‘'®l^‘«(r-l)p.o.(s-l)p.p  * 


Ifijl  1 B.  J - 1,2  . 


“ *'‘{r-l)p+o,(8-l)p+p'  *.  * '2^ 


l*jl  i (PB)*»  j - 1.2  . 


12- 


Therefore,  we  may  replace  by  the  average  over  a,  1 1 o £ P-  Thus 


u'*’  A U - f r - - f I 

r.  -1  r-l.s  w P (r- 


) ^ + E 

l)p+0,  (s-l)p+u  1 


IEj^I  1 2(pB)^h(l  + h)  . 


Each  of  the  other  terms  in  the  right-hand-side  of  (4.14)  may  be  treated  in  a similar 


ouinner.  We  obtain 


T 4 T 

V (NU)  » - 0 U + E., 
rs  rs  p rs  rs  2 


|e,|  < 16(pB)^h  . 


Finally,  using  (4.13)  we  see  that 


<0,NU>  - - (U,U>  + E 
P 


|e|  < 16(pB)^Q^h  < (16B^)  ^ . 

Corollary;  If  one  considers  the  p p bloc)(  Jacobi  iterative  method  described  by 


(4.6)-(4.9)  then 


Proof;  Apply  Theorem  3.1. 


P - 1 - ^ pjh^  + O(h^) 


We  close  this  section  with  a consideration  of  the  successive  over-relaxation 
iterative  method  based  on  this  splitting. 

Let  a parameter  u be  chosen.  Then  the  successive  over  relaxation  method  based 
on  (4.6)  is  given  by 

- ■ A 0*'*^  + B ♦AO*'  + B 0^  + (-  - DO*'  * F 

w r,s  -1  r-l,s  -1  r,s-l  1 r+l,s  1 r,s*l  u ' rs  rs 

Because  the  basic  splitting  satisfies  bloc)c  property  A the  number  p (u)  which  is 

the  related  spectral  radius  satisfies  the  equation  (see  tlSI) 

2 2 2 

(p  (u)  u - 1)  • u 0 p(u)  . 

Thus,  having  determined  p,  we  know  p (u) . 
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1 


5.  P Line  Method:  1 

A9aln,  let  p be  a fixed  integer  and  assume  that  (4.1)  holds. 


The  Interior  grid  vector  is  arranged  into  subgrid  vectors  (u^)  of  pp  entrees 


as  follows 
5.1) 


0.  - {u^  ; 1 < a < P.  1 < y ^ p)  . 

J o,(3-l)p+u  - - - 


th 


That  is,  Uj  consists  of  the  values  associated  with  the  j block  of  p lines. 


We  now  have 
5.2) 


0 - • 


Within  each  the  ordering  is  the  same.  That  is,  let  G(j,y)  be  the  P vector 


associated  with  the  horizontal  line  within  the  block  of  p horizontal 


lines,  i.e. 


G(j,y) 


l,(j-l)p+u 


2,(j-l)p+y 


Of  <j-l)P+U 


Pf  (j-i)p+u 


then 


G(j,l) 

G(j,2) 


lG(j,p)J 

The  discrete  Poisson  equation  (2.5a),  (2.Sb)  now  takes  the  form 


5.3) 


where  T and  R are  pP  by  pP  matrices.  In  fact,  T is  block  tridiagonal  with 


5.4a) 

and 


T - 

P P P p 


»p.-  f-1.4.-llp 
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I 


S.4b) 


R - 


o 


This  decomposition  is  used  to  make  the  splitting 
5.5)  A - M - N 

where 
5.6«) 

5.6b)  N - [R.O.R*]  . 

* 

It  is  immediately  clear  that  M » M and  is  positive  definite  since  each  T is 
positive  definite.  Once  more,  this  splitting  satisfies  block  property  A (see  (9), 
(10]).  Thus  (A.l)  and  (A. 2)  are  satisfied.  From  the  structure  of  N we  see  that 


M “ diagonal (T) 
„T, 


(A. 3)  is  satisfied  with  N 


2. 


Once  more  we  seek  to  determine  an  appropriate  q and  verify  (A. 4). 

Leama  S.l;  Suppose  U is  a grid  vector  which  satisfies  (i)  and  (ii)  of  (A. 4).  Then 


5.7a) 

«fhere 

5.7b) 

That  is,  (A. 4)  is  satisfied  with 

5.8a) 
and 
5. 8b) 

Proof:  We  have 

5.9) 

Consider  a term 

5.10) 

Mnr 


<NU,0>  •=  - < U,U>  + E 
P 


|e|  £ 8B  p . 


q - 2/p 


8B  p 


<HU,U>  - ? U^{NU).  . 

j-1  J J 


o»(wu)^  - oJro^_^  * 


p 

^.(j-Dptl  ’ '*o,(j-l)p 
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rix  p,  1 ^ U < p.  Then 

where 


|cj  < Bph 


Therefore,  evereging  once  more,  we  have 


O^RU.  , - - f y [u  1^4 

^ P Lp-1  0-1 


4hp^B^ 


Thus,  as  in  section  4 


<U.NU>  - - <U,0>  + E 
P 


where 


|e|  < 8B%  . 

If  we  consider  the  p line  iterative  method  described  by  (5.3) 

then 


P 


1 - pe^h^  -f 


O(h^) 


Proof I Rpply  theorem  3.1. 

iaS££k,  A careful  look  at  this  section  shows  that  K - SB^  and  hence  we 


-(5.6b) , 


easily 


Obtain 


-1 


6.  p-line  Mrtho«.)  II 

In  this  section  we  approach  the  p-linc  method  of  section  S with  another  method  of 
analysis.  The  results  obtained  are  weaker,  but  the  approach  may  well  have  applications 
in  cases  where  the  analysis  of  section  3 does  not  apply. 


Lenma  6,1:  Let  denote  the  Chebychev  polynomial  of  the  second  kind  of  order  n, 

i.e.,  u,  (x)  • 2x  and  u (x)  » 2xu  (x)  -u  , (x)  . 


If  X » 1,  then 


u <x)  > u , (x)  + 1,  n > 1 
n n“i  “ 

u (x)  > n + 1,  n > 1 

n ■“ 


6-lc)  u (x)  > u , (x)  + 2n  . 

ax  n — dx  n-1 

Proof:  Apply  induction. 

Corollary:  “^(x)  >^2,  n ^ 1 and  x ^ 1. 

I-OBUM  6.2;  Let  B “ (-I,2S,-II  where  S and  I are  n * n.  Let 

B 

Oj(S)  - u^(S)  , 

that  is,  0^(S)  is  an  n * n matrix  obtained  by  evaluatinq  the  Chebychev 

polynomial,  at  S.  If  0 (S)  is  nonsingular,  then 


.(S),  j < i , 
m j*!  m-i  “ 


o"  (S)0.  , (S)U  .(S),  i < j . 
■ 1*1  m-j  — 


Proof : See  Theorem  1 of  13] . 

The  quantity  of  interest.  P,  is  the  spectral  radius  of  m”^N.  Since 

•1  “I  -1  T 

M • (T  R,0,T  R J 

Use  section  5)  we  may  apply  Lemma  6.2  to  obtain  t”^  and  hence  m"^N.  We  find  that 

- (0,0, EJ 
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6.6) 


P < B - vax  fu  ) (u  .(*  ) * u )))  . 

- P j.  P r p-j  r j-1  r 

LMwa  6.3:  If  » i.  1,  then 

6.7)  u_(x)  + u , (x)  > u , (x)  ■*•  u .(x),  j - 1,2,  — ,p  . 

0 p-1  — J-l  p-j 

Proof;  For  * i 1 end  i ^ 2,  from  the  basic  recursion  formula  and  (6.1b)  we  have 

Uj^(x)  - 1 “i-l*’‘'  ” “1-2**'  ' 

Thus,  if  n > m > 0 we  have 

u (x)  - u , (x)  > u (x)  - u , (x)  , 
n n-1  — m m-1 


or 

6.8)  u (x)  + u , (x)  > u (x)  + u , (x)  . 

n m-l  — m n-1 

Of  course  (6.7)  is  true  for  j " 1 and  j “ p.  Assume  that  (6.7)  is  true  for  a 
value  of  j-o,  l^o^p-2.  Then 

6.9)  '»-(x)  + u , (x)  > u (x)  + u ^(x)  . 

0 p-1  — 0-1  p-0 

He  may  assume  o < p - o.  Then  applying  (6.8)  with  n • p - o and  m ■ o we  find 

^ “n  1 1".,  • 

p-o  0-1  — p-(0+l)  0 

That  is 


U ^(X)  + , (X)  > U.(X)  + U^  • 

p-o  0-1  — 3 p-(j+l) 

Substitution  of  this  result  into  (6.9)  ^ives  (6.7)  for  the  larger  value  of  j and  tlie 
lasM  is  proven. 


Theorem  6.1:  With  B defined  by  (6.6)  we  have 

p 


6.10) 

Proof  1 From  Lemma  6.3  we  see  that 


P(M*^N)  < B - 1 - ? tr^h^  + O(h^)  . 

— p 2 


B ■ MX 


"p‘^» 


where  the  1^  are  given  by  (6.4c).  It  is  not  difficult  to  see  that 


B^(l) 

P 


u„(X) 

P 


19 


• •onoton*  non-tlccr«asin9  function  of  A for  A > 1.  Thus 

1 u , (2  - cosBh) 

• . szl . 

P “ <2  - cosnh) 

P 

Expansion  of  Bp(A)  about  A » 1 yields  (6.10). 

Final  Remark;  Since  it  is  better  to  slightly  overestimate  the  relaxation  pararoeter  in 
successive  overrelaxation  than  to  underestimate  it,  it  might  appear  that  the  estimate 

section  is  preferable  to  that  of  section  5 for  coarse  meshs . However,  numerical 
•xpsriments  contradict  this  idea. 
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